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PICTURE SIGNAL TRANSMTmNG 
METHOD AND APPARATUS 

RELATED APPUCATION 

This is a continuation-in-part of U.S. patent application ^ 
Ser. No. 08/219,472. filed Mar. 29. 1994. now U.S. Pat. No. 
5.473380. 

BACKGROUND OF THE INVENTION 

The present invention relates to coding and decoding of a ■ 
picture signal for transmission, and. more particularly, is 
directed to matching the type of predictive coding af^lied to 
pictures of the picture signal 

In, for example, a teleconferencing system or a video 15 
telephone system, moving picture signals are compressed 
and encoded by taking advantage of intra-frame and inter- 
frame correlation so that they can be more efficiently trans- 
mitted over a communication channel to a remote location. 

Intra-ftame correlation can be utilized by an orthogonal 20 ! 
transfcHTnation, such as a discrete cosine transf conation 
(DCT). 

Inter-frame correlation can be utilized by predictive 
encoding between successive pictures. As used herein, a 
picture geno-ally refers to an image represented by a frame. 25 
When the fields of a frame are coded in a non-interlaced 
manner, that is, separately, each field may be referred to as 
a picture. 

As shown in FIG. lA. for cxsanple, frame pictures PCl. 
PC2 and PC3 are generated at time points tl, t2 and t3. As \ 
shown by shading in FIG. IB. the diflference between the t 
frame pictures PCI and PC2 is obtained as difference picture ; 
data PC12, and the difference between the frame pictures • 
PC2 and PC3 is obtained as difference picture data PC23. ? 
Since there is a fairly small change between signals of 
temporally neighboring frames, transmission of only the 
difference picture data utilizes the transmission channel 
more efficiently than transmission of the original pictures. 
That is. using the difference picture data as encoded picture 
signals reduces the amount of data to be transmitted. ^ 

However, if only the difference signals are transmitted, 
the original picture cannot be restored. It is advantageous to 
occasionally transmit a picture which is not predictively 
encoded as a reference for difference picttire data, and 
because it is sometimes more efficient than transmitting the 
picture as a predictively encoded picture. 

Pictures which are encoded utilizing only intra-frame 
correlation and not inter-frame correlation, are referred to 
herein as intra-pictures or I-pictures. 

Pictures whidi are encoded with predictive encoding 
relative to one previously encoded picture are referred to 
herein as predictive pictures or P-pictures. The previously 
encoded picture may be an I-picture or a P-picture. and 
temporally succeeds the P-picture. 

Pictures which are encoded with predictive encoding 
relative to at most two pictures, a temporally preceding and 
a ten^xjrally succeeding picture, are referred to herein as 
bi-directionally predictive coded pictures or B-pictures, The 
two pictures may each be an I-picture or a P-picture, When ^ 
both are used, the mean value of the two pictures is obtained 
and used as a reference picture for the picture to be encoded. 

A series of pictures may be considered as groups of 
pictures having a predetermined number of frames such as 
Fl . . . FI7. The luminance and chrominance picture signals 65 
of the leading frame Fl are encoded as an I-picture. the 
picture signals of the second frame F2 are encoded as a 
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B-picture. and the picture signals of the third firamc F3 are 
J encoded as a P-picturc. The fwrth and the following frames 
F4 to F17 arc encoded alternately as B-picturcs and 
P-pictures. FIG. 2A shows the reference pic&ires used for 
5 encoding P-pictures. while FIG. 2B shows the reference 
pictures used for encoding B-pictures. 

As shown in FIGS, 3A and 3B, there are four methods for 
encoding the macro-blocks (discussed below) of a picture. 
When multiple methods are suitable, the method which will 
10 give the smallest amount of encoded data is employed on a 
macro-block by macro-block basis. Blocks Fl to F5 in FIG. 
[ 3A represent data for frames of moving picture signals, 
whereas blocks FIX to F5X in FIG. 3B represent data for 
encoded frames. The solid line arrows in FIG. 3A show the 
! 15 frames to which motion vectors xl . . . x6 relate. 

The first method, shown as SPl. is to not use predictive 
encoding, that is. to use only intra-frame correlation. This is 
suitable for any macro-blocks of an I-picture. a P-picturc and 
a B-picture. In other words, if less encoded data is produced 
without predictive encoding, then this method is selected. 

The second method, shown as SE*2, is to predictively 
encode relative to a picture which temporally succeeds the 
■ - ' - current picture, referred to as backward predictive encoding. 

. ^ The third method, shown as SP3. is to predictively encode 
. relative to a picture which temporally precedes the current 

=^ picture, referred to as forward predictive encoding. The 

n second method is suitable for macro-blocks of only 

r* B-pictur«s. The third method is suitable for macro-blocks of 

^ P-pictures and B-pictures. 

The fourth method, shown as SP4. is to predictively 
encode relative to the mean value of two pictures, one 
temporally preceding and one ten^wrally succeeding the 
pj current picture. This method is suitable for macro-blocks of 

^ 35 only B-picturcs. 

J The encoding sequence will now be described 

= ' The first frame Fl is encoded as an I-picmre using the first 

— method SPl so that it is directly transmitted over a trans- 

I y mission channel as encoded data FIX- 

O ^ The third frame F3 is encoded as a P-picture. When the 

fy third method SP3. forward predictive coding, is used for a 

f— macro-block, difference signals from the temporally preced- 

^ ing frame Fl used as the reference picture, as indicated by 

^ a broken-line arrow SP3, and a motion vector x3 between 

the reference picture Fl and the cinrent picture F3. are 
calculated and encoded as data F3X for that macro-block. 
Alternatively, in this or another macro-block of the P picture, 
if a smaller amount of encoded data is produced for a 
macro-block of the P picture being encoded, the first method 
^ SPl can be used whaein the data of the original frame F3 
are directly utilized as the transmission data F3X for that 
macro-block. 
The second frame F2 is encoded as a B-picture, 
55 When the fourth method SP4 is used to encode a macro- 
block of the frame F2. a difference between the mean value 
of the tempOTally preceding frame Fl and the temporally 
succeeding frame F3 is calculated, on a pixel by pixel basis. 
The difference data and the motion vectors xl and x2 are 
gQ encoded as data F2X. 

When the first processing method SPl is used to encode 
a macro-block of the frame F2. the data of the coiginal frame 
F2 forms the encoded data F2X. 

When one of the second or third methods SP2. SP3 is used 
65 to encode a macro-block of the frame F2. one of the 
difference between the temporally succeeding frame F3 and 
the current frame F2, and the difference between the tem- 
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porally preceding frame Fl and the current frame E2 is 
calculated. The difference data and one of the motion vectors 
xl, x2 are encoded as the data F2X. 

The frame F4 fa the B-picture and the frame F5 for the 
P-picture arc processed in a similar manner as described 5 
above to generate transmitted data F4X and F5X. 

FIG. 4 illustrates an arrangement for encoding and decod- 
ing moving picture signals in accordance with the above- 
described predictive encoding scheme. As shown in FIG. 4. 
an encoding device 1 encodes input picture signals and 
transmits the encoded signals to a recording medium 3 as a 
transmission channel for recording. A decoding device 2 
reproduces the signals recorded on the recording medium 3 
and decodes these as output signals. 

The encoding device 1 includes an input terminal 10. a 
pre-processing circuit 11. A/D converters 12 and 13. a frame 
memory 14 including a luminance signal frame memory 15 
and a color difference signal frame memory 16. a format 
converting circuit 17 and an encoder 18. 

20 

Input terminal 10 is ad^ted to receive a video signal VD 
and to supply the signal VD to pre-processing circuit 11 
whidi functions to separate the video signal VD into lumi- 
nance signals and color signals, herein chrominance or coIot 
difference signals, that are applied to analog-to-digital (A/D) ^ 
converters 12 and 13, respectively. The video signals, digi- 
tized by analog- to-digital conversion by the A/D converters 
12 and 13. are supplied to frame memory 14 having memo- 
ries IS. 16 which function to store the luminance signals and 
the color difference signals, respectively, and to read out the ^ 
signals stored therein to format converting circuit 17. 

The converter 17 is q>erativc to convert frame fonnat 
signals stored in the frame memory section 14 into block 
format signals. As shown in FEG. SA. pictures are stored in 
the frame memory section 14 as frame-format data having V 35 
lines each consisting of H dots. The converting circuit 17 
divides each frame into N slices, each slice comprising a 
nmltiple of 16 lines. As shown, in FIG. SB. the converter 17 
divides each slice into M maao-blocks. As shown in FIG. 
5C, each macro-block represents luminance signals Y cor- ^ 
responding to 16x16 pixels or dots, and associated chrx)nii- 
nance G. Cb signals. These luminance signals are sub- 
divided into blocks Yl to Y4. each consisting of 8x8 dots. 
The 16x16 dot luminance signals are associated with 8x8 
dot Cb signals and 8x8 dot Cr signals. The converter 17 is ^5 
also operative to supply the block format signals to the 
encoder 18. which is described in detail below with refer- 
ence to FIG. 6. 

The encoder 18 operates to encode the block format 
signals and to supply the encoded signals as a bitstreara over 50 
a transmission diannel for recording on the recording 
medium 3. 

The decoding device 2 includes a decoder 31, a format 
converting circuit 32. a frame memory section 33 including 
a luminance signal frame mem<»y 34 and a color difference 55 
signal frame memory 35. digital-to-analog converters 36 and 
37. a post-processing circuit 38 and an output terminal 30. 

The decoder 31 is operative to reproduce encoded data 
from the recording medium 3 and to decode the encoded 
data, as described in detail below with reference to FIG. 9, 60 
and to supply decoded data signals to format converting 
circuit 32 which is operative to convert the decoded data 
signals into frame format data signals and to supply the 
frame format data signals as luminance signals and coIot 
difference signals to the memory 33. The memories 34. 35 65 
of the memory 33 function to store the luminance and 
chrominance signals, respectively, and to apply these signals * 
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to D/A converters 36 and 37, respectively. The analog 
signals from converters 36. 37 are synthesized by a post- 
processing circuit 38 which functions to f<xm output picture 
signals and to ou^ut them to output terminal 30. and thence 
s to a display unit, such as a CRT. not shown, for display. 

FIG. 6 illustrates flie encoder 18 shown in FIG. 4. 

Generally, the encoder 18 stores three pictures, the current 
picture and the pictures temporally preceding and succeed- 
ing the current picture. Based on the sequential position of 
*° the current picture in the group of pictures, the picture 
coding type (I, P or B) is selected fOT each picture. The 
picture type sequence is determined by a usa: using picture 
type input device 65. independent of the pictures applied to 
an input terminal 49. 

The encoder 18 also chooses one of frame-based and 
field-based predictive encoding as will be explained with 
reference to FIG. 7, and further chooses one of frame-based 
and field-based DCT encoding as will be explained with 
reference to FIG. 8. For each picture, aRjropriatc motion 
vectors are obtained and the picture is predictively encoded 
relative to zero, one or two previously encoded pictures 
whidi have been locally decoded and whidi are referred to 
as reference pictures to form a difference data signal. The 
difference data signal is orthogonally transformed into 
blocks of coefficient data which are quantized, variable 
length eacoded and transmitted as encoded data. 

At the encoder 18, the quantized data are dequantized. 
inverse orthogonally transformed, and stored as the refer- 
^ ence pictures. The predictive encoding applies the motion 
vectOT(s) obtained for the current picture to the reference 
picture(s) to produce a prediction picture which is subtracted 
from the current picture to yield the difference data. 

The elements of the encoder 18 will now be explained in 
35 detail. 

Picture data for encoding is supplied macro-block by 
macro-block to the input terminal 49 and thence to a motion 
vectOT detection circuit SO which is operative to process the 
picture data of respective frames as I-pictures, P-picturcs or 

40 as B-pictures, in accordance with a predetermined sequence 
for each group of pictures, as shown for example, in FIGS. 
2A. 2B. The circuit 50 applies the picture data of the current 
frame to a frame memory 51 having frame memories 51a, 
Sib. Sic used for storing a temporally preceding picture, the 

45 current picture and a temporally succeeding picture, respec- 
tively. 

More specifically, the frames Fl. F2, F3 are stored in the 
memories 51a, 5LE>. 51c. respectively. Then the picture 
stored in memory 51c is transferred to memory 51a. The 

50 frames F4. F5 are stored in the memories 51*. 51c, respec- 
tively. The operations of transferring the picture in memory 
Sic to memory 51a and storing the next two pictures in 
memories Sib. 51c are repeated for the remaining pictines in 
the group of pictures. 

55 After the pictures are read into the memory and tempo- 
rarily stored, they are read out and supplied to a prediction 
mode diangeover circuit 52 which is adapted to process the 
current picture for one of frame based and field based 
predictive encoding. After pn'ocessing the first frame picture 

60 data in a group of pictures as an I-picture and before 
processing the second frame picture as a B-picture, the 
motion vector detection circuit 50 processes the third frame 
P-picture. The processing sequence is different from the 
sequence in wWch the pictures are supplied because the 

65 B-picture may involve badcward prediction, so subsequent 
decoding may require that the P-picturc temporally succeed- 
ing the B-picture have been previ<x)sly decoded. 



5 

The motion vector detection circuit 50 calculates as an 
estimated value for intra-coding for each macro-block, the 
sum of absolute values of prediiciion errors for the firame 
prediction mode for each maoro-blodc and the sum of 
absolute values of prediction errors for the field prediction 5 
mode for each maao-block and suf^lies diese sums to the 
prediction decision circuit 54 which compares these sums 
and selects frame prediction mode or field prediction mode 
in accordance with the smallest of these values and provides 
the selected mode to the prediction mode changeover circuit lO 
52. 

If the frame prediction mode is selected, the prediction 
mode changeover circuit 52 ou^uts the four luminance 
blocks Yl to Y4 and the two chrominance or color difference 
blocks Cb. Cr of each macro-block received from the motion 15 
vector detection circuit 50 without processing. As shown in 
FIG. 7A. odd or first field line data, indicated by solid lines, 
and even or second field line data, indicated by dashed lines, 
alternate in each luminance and color difference block as 
received from the motion vector detection circuit 50. In FIG. 
7 A, a indicates units for motion compensation. In the frame 
prediction mode, motion con^nsation is performed with 
four luminance blocks (macro-blocks) as a unit and a single 
motion vector is associated with the four luminance blocks 
Yl to Y4. 25 

If the field prediction mode is selected, the prediction 
mode changeover circuit 52 processes the signals received 
from the motion vcctOT detection circuit 50 so that each of 
the four luminance blocks comprises data from a single field 
and the two color difference blocks have non-interlaced odd 
and even field data. Specifically, as shown in FIG. 7B, the 
luminance blocks Yl and Y2 have odd-field data and the 
luminance blocks Y3 and Y4 have even-field data, while the 
upper halves of the color difference blocks Cb. Or represent 
odd field color difference data fOT the luminance blocks Yl 
and Y2 and the lower halves of the color difference blocks 
Cb. Cr rejH-cscnt even field color difference data for the 
luminance blocks Y3 and Y4. In FIG. 7B. b indicates units 
for motion compensation. In the field prediction mode, 
motion con^nsation is perfonncd separately for the odd- 
field blocks and even-field blocks so that one motion vector 
is associated with the two luminance blocks Yl and Y2 and 
another motion vector is associated with the two luminance 
blocks Y3 and Y4. 

45 

The prediction mode changeover circuit 52 supplies the 
current picture, as processed for frame based or field based 
predictive encoding, to arithmetic unit 53 of FIG. 6. The 
arithmetic unit 53 functions to perform one of intra-picture 
prediction, forward prediction, backward prediction or ^ 
bi-directional prediction. A prediction decision circuit 54 is 
adapted to select the best type of prediction in dqjendence 
upon the prediction error signals associated with the current 
picture signals. 

The motion vector detection circuit 50 calculates, for the 55 
current picture, the sum of absolute values of the differences 
between each Aij and the average value of the Aij in each 
macro-block IIAij-(average of Aij) I and supplies the sum as 
an estimated value for intra-coding to the prediction decision 
circuit 54. go 

The motion vector detection circuit 50 calculates the sura 
of absolute values (or sum of squares) of the difference (Aij 
-Bij) between signals Aij of the macro-blocks of the current 
picture, and signals Bij of the macro-blocks of the prediction 
picture LlAij-BijI in each of frame prediction mode and field 65 
prediction mode. As explained above, the m(^on vector(s) 
for the current picture are applied to the reference picture(s) 



50 



35 



25 



to generate the prediction picture. When the reference pic- 
ture temporally precedes the current picture, the quantity 
IlAij-Bijl is referred to as a forward prediction enx>r signal, 
and when the reference picture temporally succeeds the 
5 current picture, the quantity HAij-Bijl is referred to as a 
backwanl prediction error signaL When the prediction pic- 
ture is the mean of a tenqx)rally preceding and a temporally 
succeeding reference picture, as motion-compensated, the 
quantity SAij— Biji is rcfeired to as a bi-directional predic- 
10 Uon eiror signal. 

The circuit 50 supplies the forward frame prediction, the 
forward field prediction, the backward frame prediction, the 
backward field prediction, the bi-directional frame predic- 
tion and the bi-directional field prediction error signals to the 
15 prediction decision circuit 54. 

The prediction decision circuit 54 selects one of intra- 
coding. forward inter-picture prediction, baclcwaid inter- 
picture prediction or bi-directional inter-picture prediction 
and one of frame and field [n-ediction mode in accordance 
^ with the smallest of the estimated value for intra-coding and 
the forward frame, the forward field, the backward frame, 
the backward field, the bi-directional frame and the 
bi-directional field prediction error signals. The arithmetic 
unit 53 prcdictivcly encodes the current picture, as processed 
by the frame or field changeover circuit 52. in accordance 
with the prediction mode selected by the prediction decision 
circuit 54. 

The motion vectOT detection circuit 50 serves to calculate 
and supply the motion vector(s) associated with the selected 
prediction mode to a variable length encoding circuit 58 and 
a motion compensation circuit 64. explained lata. 

The sums of the absolute values of the inter-frame dif- 
ferences (prediction errors) on the macro-block basis are 
35 suH)licd from the motion vector detection circuit 50 to the 
prediction mode changeover circuit 52 and to the prediction 
decision circuit 54. in the manner as described above. 

The arithmetic unit 53 supplies predictively encoded data, 
also referred to as diflferencc data, for the current picture to 

40 a DCr mode changeover circuit 55 which is adapted to 
process the current pic&ire for one of frame based and field 
based orthogonal transformation. 

The DCT changeover circuit 55 frinctions to compare the 
encoding cflSdcncy when the EMIT operations for the macro- 
blocks in a picture are performed with the odd field data 
alternating with the even field data, that is. for frame based 
orthogonal transformation, as shown in FIG. 8A, with the 
encoding cflBdency when the DCT operations for the macro- 
blocks in a picture are perfOTmed with the odd field data 

50 separated from the even field data, that is. for field based 
orthogonal transformation, as shown in FIG. 8B. The circuit 
55 functions to select the mode with the higho- encoding 
efficiency. 

To evaluate the encoding eflBciency for frame based 
orthogonal transformation, the DCT mode changeover cir- 
cuit 55 places the luminance macro-block data into inter- 
laced form, as shown in FIG. 8A, and calculates the differ- 
ences between the odd field Une signals and even field line 
signals vertically adjacent to each <^er. and finds the sum 
^ of absolute values of the differences EFM, or the sum of 
squared values of the differences. 
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16 16 16 16 Eq. I 

1=1 /=l r=l 

To evaluate the encoding eflSdency for field based 
orth(^onal transformation, the DCT mode diangeovcr cir- 
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cult 55 places the luminance macro-block data into non- 
interlaced form, as shown in FIG. 8B. and calculates the 
differences between vertically adjacent odd field line signals 
and the differences between vertically adjacent even field 
line signals, and finds the sum of absolute values of the s 
differences EFD. or the sum of squared values of the 
differences. 

16 15 Eq. 2 

EFD = I, Z (loCy-) - °ii + Uy + Kv") - <i + lrf")0 

J=\ (=1 10 

The DCT diangeover circuit 55 compares the difference 
between the frame based and field based sums of the 
absolute values with a predetermined threshold and selects 
frame based DCT transformation if the difference EFM- 
EFD is less than the predetermined threshold. 
- If the firamc prediction mode is selected in the prediction 
mode changeover circuit 52, the probability is high that the 
firame DCT mode will be selected in the DCT mode 
diangeover circuit 55. If the field prediction mode is 
selected in the prediction mode changeover circuit 52. the 
jH-obability is high that the field DCT mode will be selected 
in the DCT mode changeover circuit 55. However, since this 
is not necessarily the case, the prediction mode changeover 
circuit 52 sets the mode whicii will give the least value of the ^ 
sum of the absolute values of prediction errors, while the 
DCT mode changeover circuit 55 s^ the mode which will 
give the optimum orthogonal transformation encoding effi- 
ciency. 

^ If frame based orthogonal transformation mode, also ^ 

referred to as fi-ame DCT mode, is selected, the DCT mode 
SJ diangeover circuit 55 functions to ensure that the four 

f4 luminance blocks Yl to Y4 and two color difference blocks 

^ Cb. Or represent alternating or interlaced odd and even field 

lines, as shown in FIG, 8A. 35 
yl If field based orthogonal transformation mode, also 

= referred to as field DCT mode, is selected, the DCT mode 

f=^ diangeover circuit 55 functions to ensure that eadi of the 

luminance blocks represents only one field, and that each of 
f the color difference blocks has segregated or non-interlaced 

O odd and even field lines, as shown in FIG. 8B. 

pj The DCT mode changeover circuit 55 functions to output 

f»! the data having the configuration associated with the 

^ selected DCT mode, and to output a DCT flag indicating the 

^ selected DCT mode to the variable length encoding circuit 45 

58 and the motion compensation circuit 64. 

The DCT mode changeover circuit 55 supplies ^propri- 
atcly configured difference picture data to a EKIT circuit 56 
shown in FIG. 6 which is operative to colhogonally trans- 
form it using a discrete cosine transformation into DCT 50 
coefficients, and to supply the DCT coefficient data to a i 
quantization circuit 57 that functions to quantize the coef- 
ficient data with quantization steps selected in accordance 
with the volume of data stored in a transmission buffer 59 
and to supply quantized data to a variable length encoding 55 
circuit 58. • 

The vari^le length encoding circuit 58 is also supplied 
with the quantization stq) or scale data from the quantization 
circuit 57, prediction mode data firom the prediction decision 
circuit 54, tfiat is data indicating which of the intrapicuue 60 
prediction, forward prediction, backward prediction or 
bi-directional prediction is used, and motion vector data 
from the motion vector detection circuit 50. The encoding 
circuit 58 also receives prediction flag data from the pre- 
diction dedsion circuit 54 comprising a flag indicating 65 
which of the frame prediction mode or the field prediction 
mode is used, and prediction flag data from the DCT mode 
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changeover drcuit 55 comprising a flag indicating which of 
the frame DCT mode or the field DCT mode is used. This 
information is placed into the header portion of the encoded 
data stream. 

The variable length encoding circuit 58 serves to encode 
the quantized data and the header information using a 
variable length code such as a Huffman code, in accordance 
with the quantization step data supplied from the quantiza- 
tion circuit 57. and to output the resulting data to a trans- 
10 mission buffer 59. 

The quantized data and quantization step are also supplied 
to a dequantization circuit 60 whidi serves to dequantize the 
quantized data using the quantization step, and to supply the 
recovered DCT coefficient data to an inverse DCT circuit 61 
that functions to inverse transform the DCT coefficient data 
to produce recovered difference data and to supply the 
recovered difference data to an arithmetic unit 62. 
The arithmetic unit 62 combines the recovered difference 
^ data with a previously encoded and decoded reference 
picture, as motion compensated, to produce decoded data for 
a reconstructed picture which will be used as a reference 
picture and whidi is read into one of two frame memories 
63a. 63b. The memories 63a, 63b are adapted to read out the 
reference picture data stored therein to a motion compen- 
sation circuit 64 that uses the motion vectors from the 
motion vector detection circuit 50 to produce a prediction 
picture from the reference picture. Specifically, the circuit 50 
uses the motion vector to alter the readout address of the 
reference picture from the memoy 63a or 63b. 

For a group of pictures, after the first frame I-picture data 
and the third frame P-picture data arc stOTed in the forward 
and backward prediction picture memories or units 63fl. 63fc. 
respectively, the second frame B-picture data is processed by 
the motion vector detection circuit SO. The prediction deci- 
sion circuit 54 selects the frame or field prediction mode, 
while setting the prediction mode to one of intra-frame 
prediction mode, forward prediction mode, backward pre- 
diction mode and bi-directional prediction mode in cotre- 
^ spondence with the sum of absolute values of predictive 
errors by macro-block. 

Since a reconstructed B-picture is not used as a reference 
picture for other pictures, it is not stored in the frame 
memory 63. 

45 It will be appreciated that the frame memory 63 has its 
forward and backward prediction picture units 63a. 63b 
bank-exchanged as needed so that a picture stored in one of 
the units 63a or 63b can be outputted as either a forward or 
a backward prediction picture. 

50 The motion compensation circuit 64 functions to supply 
the motion compensated data as a prediction picture to the 
arithmetic unit 62 and to the arithmetic unit 53 which 
subtracts the prediction picture from the P-picturc or the 
B-picture currently being predictively encoded. 

55 More specifically, when the motion vector detection cir- 
cuit 50 receives picture data for an I-picturc from the 
forward original picture unit 51a, the prediction decision 
circuit 54 selects the intra-frame prediction mode and sets a 
switch 53d of the arithmetic unit S3 to an input contact a. 

50 This causes the I-picture data to be inputted directly to tiie 
DCT mode changeover circuit 55. In this case, no prediction 
picture is expected from the motion compensation circuit 64. 
The I-picture data is also supplied to the forward prediction 
picture unit 63a. 

i5 When the forward prediction mode is selected by the 
prediction decision circuit 54. the circuit 54 also sets the 
swttdi S3d to an inpHJt contact b which causes the arithmetic 
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unit 53o to subtract the predictioa picture, produced by the 
motion compensation circuit 64, from the picture read out 
from the memory 51, for each maao-block on a pixel by 
pixel basis, to produce difference data. The P-picturc. after 
encoding and local decoding, is supplied to one of the units 5 
63a. 63fr. For example, if tfic P-picturc immediately follows 
an I-picture. then the P-picture is stored in the backward 
prediction picture unit 63fc. 

For forward predictive encoding, the prediction picture is 
a reference I-picture or P-picture read out from the forward 
prediction picture unit 63a of the frame memory 63 and 
motion-compensated by the motion compensatioQ circuit 64 
in accordance with the motion vector ouq)utted from the 
motion vector detection circuit 50. More specifically, for 
eadi macro-block, the motion compensation circuit 64 shifts *5 
the readout address of the forward prediction picture unit 
63a in an amount corresponding to the motion vector 
currently output by the motion vector detection circuit 50. 

When the backward prediction mode is selected by the ^ 
prediction decision circuit 54, the circuit 54 also sets the 
switch 53d to an input contact c which causes the arithmetic 
unit Sib to subtract the prediction picture, produced by the 
motion compensation circuit 64. from the picture read out 
from the memory 51, on a pixel by pixel basis, to produce ^ 
difference data. 

For backward predictive encoding, the prediction picture 
is a P-picture read out from the backward prediction picture 
unit 63b of the frame memory 63 and motion-compensated 
by the motion compensation circuit 64 in accordance with ^ 
the motion vector ouiputted from the motion vector detec- 
tion circuit 50. More specifically, for each macro-block, the 
motion compensation circuit 64 shifts the readout address of 
the backward prediction picture unit 636 in an amount 
corresponding to the motion vector currently output by the 
motion vector detection circuit 50. 

When the bi-directional prediction mode is selected by the 
p-ediction decision circuit 54. the circuit 54 sets the switch 
S3d to an input contact d which causes the arithmetic unit 
53c to subtract a prediction picture from the picture read out ^ 
from the memory 51, on a pixel by pixel basis, to produce 
dififercnce data. The prediction picture is the mean value of 
a forward prediction picture and a backward prediction 
picture. 

In the case of bi-directional prediction, the picture stored 45 
in the forward prediction picture unit 63a. and the picture 
stored in the backward prediction picture unit 63b, arc read 
out and motion-con^)ensatcd by the motion compensation 
circuit 64 in dqwndence upon the motion vectors outputted 
from the motion vector detection circuit 50. More 50 
specifically, for each macro-block, the motion compensation 
circuit 64 shifts the readout address of the forward and 
backward prediction picture units 63a, 63b in an amount 
corresponding to the q>propriate one of the motion vectors 
currently output by the motion vector detection circuit 50. 55 

The transmission buffer 59 temporarily stores the data 
supplied thereto, generates control data indicating the vol- 
ume of data stored therein and supplies the control data to 
the quantization circuit 57. When the volume of data stored 
in the transmission buffer 59 reaches a predetermined upper 60 
limit value, the control data from the transmission buffer 59 
causes the quantization scale of the quantization circuit 57 to 
increase so as to decrease the volume of the quantized data. 
Similarly, when the volume of daU stored in the transmis- 
sion buffer 59 reaches a predeterniined lower Umit value, the 65 
control data from the transmission buffer 59 causes the 
quantization scale of the quantization circuit 57 to decrease 
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so as to increase the volume of the quantized data. In this 
manner, the transmission buffer 59 prevents the data sup- 
plied thereto from overflowing or underflowing its capacity. 
The data stored in the transmission buffer 59 are read out at 

5 a predetermined timing to an ouQ>ut terminal 69 and thence 
to a transmission channel for recording on. for example, the 
recording medium 3. 

Although the foregoing description has been made with 
reference mainly to the luminance blocks, the color diffcr- 

10 cnce blocks arc similarly processed and transmitted using 
the motion vector which corresponds to the motion vector of 
the luminance block halved in both the vertical and hori- 
zontal directions. 
FIG. 9 illustrates the decoder 31 shown in FIG. 4. 

* ^ The reproduced encoded picture data transmitted from the 
recording medium 3 is applied to a reception circuit, not 
shown, or to an input terminal 80 which applies the encoded 
picture data to a reception buffer 81 that serves to tempo- 
rarily store the encxKled picture data and to supply this data 

^ to a variable length decoding circuit 82 of a decoding circuit 
90. 

The variable length decoding circuit 82 functions to 
variable length decode the encoded data, to output the 
recovCTcd motion vector, prediction mode da t a, prediction 

^ flags and DCT flags to the motion compensation circuit 87. 
and to output the quantization step data and variable length 
decoded picture-data, including the predictive mode, the 
motion vector, the predictive flag, the DCT flag and the 

^ quantized picture data for each macro-block, to an inverse 
quantization circuit 83. 

The inverse quantization circuit 83 is adapted to dequan- 
tize the picture data supplied from the variable length 
decoding circuit 82 in accordance with the quantization step 

2j data supplied from the variable length decoding circuit 82 
and to output the thus recovered coefficient data to an 
inverse transformation IDCT circuit 84. 

The IDCr circuit 84 is adapted to perform an inverse 
transformation on the recovered coefficient data to produce 

^ recovered difference data, and to supply the recovered 
difference data to an arithmetic unit 85. 

If the recovered difference data supplied from the IDCT 
circuit 84 represents an I-picture. the arithmetic unit 85 does 
not jffocess the data and simply supplies it through an output 

45 terminal 91 to the format converting circuit 32 shown in 
FIG. 4, and to a forward prediction picture unit 86a of a 
frame memory 86. 

If the recovered difference data supplied from the IDCT 
circuit 84 represents a macro-block of a P-picturc produced 

50 in the forward prediction mode, then the reference picture 
data of the preceding frame, as stored in the forward 
prediction picture memory 86o of the frame memOTy 86. is 
read and motion-compensated by a motion compensation 
circuit 87 in dependence upon the motion veaor outputted 

55 from the variable length decoding circuit 82 to generate a 
prediction picture. Specifically, the motion compensation 
circuit 87 uses the motion vectOT to alter the read out address 
sui^lied to the memory 86o. The arithmrtic unit 85 adds the 
prediction picture to the recovered difference data to pro- 

60 ducc a decoded or reconstructed picture which is stored in a 
backward {n^ediction picture memory 96b of the frame 
memory 86. The decoded P-picture is retained in the decoder 
31. and output after the next B-picture is decoded and 
output, so as to restore the pictures to the order in which they 

65 were supplied to the encoder 18 of FIG. 4. 

Even if the macro-block of the P-picture was encoded as 
intra-coded mode data, the decoded P-picture is directly 
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stored id the backward prediction picture unit 96b. without 
being output to the output terminal 91 by the arithmetic unit 
85. 

If the recovered difference data supplied from the WCT 
circuit 84 represents a macro-block of a B-pirturc encoded 5 
in the intra-coding mode, as d^crmined from the prediction 
mode supplied from the variable length decoding circuit 82 
to the motion compensation circuit 87. a prediction picture 
is not generated. 

If the recovered difference data supplied from the IDCT 
circuit 84 represents a macro-block of a B^)icturc encoded 
in the forward prediction mode, as determined from the 
prediction mode supplied from the variable length decoding 
circuit 82 to the motion compensation circuit 87, the data 
stored in the forward prediction picture unit 86a of the ft^e 
memory 86 is read out and motion compensated by the 
mcdon compensation circuit 87 using the motion vector 
supplied from the variable length decoding circuit 82 to 
form the prediction picture. The arithmetic unit 85 sums the 
recovered difference data with the prediction picture to form ^ 
the recovered B-picture. 

If the recovered difference data supplied from the IDCT 
circuit 84 represents a macro-block of a B-picture encoded 
in the backward prediction mode, as determined from the 
prediction mode supplied from the variable length decoding 
dicuit 82 to the motion compensation circuit 87. the data 
stOTed in the backward prediction picture unit S6b is read out 
and motion compensated by the mc^on compensation cir- 
cuit 87 using the motion vector supplied from the variable ^ 
length decoding circuit 82 to form the prediction picture. 
The arithmetic unit 85 sums the recovered difference data 
with the prediction picture to form the recovered B-picture. 

If the recovered difference data supplied from the IDCT 
circuit 84 represents a macro-block of a B-picture encoded 
in the bi-directional prediction mode, as determined from 
the prediction mode supplied from the variable length 
decoding dicuit 82 to the motion compensation circuit 87. 
the data stored in both the forward and backward prediction 
picture memories 86a, S6b are read out and respectively ^ 
motion compensated by the motion condensation circuit 87 
using Oie motion vectors su[^lied from the variable length 
decoding circuit 82. then averaged to form the prediction 
picture. The arithmetic unit 85 sums the recovered difference 
data with the prediction picture to form the recovered 
B-picture. 

The recovered B-picture is supplied via the output termi- 
nal 91 to the format converting circuit 32. However, since 
the B-picture is not utilized for generating a prediction 
picture for other pictures, it is not stored in the frame ^ 
memory 86. 

After (xitputting of the B-picture. picture data of the 
P-picture stored in the backward prediction picture unit S6b 
is read and supplied via the motion compensation circuit 87 
to the arithmetic unit 85. Motion compensation is not 55 
performed at this time. 

The counterpart circuits to the prediction mode 
changeover circuit 52 and the DCT mode changeover circuit 
55 in the encoder 18 of FIG. 6 are not shown in the decoder 
31. The fffocessing to be performed by these circuits, that is, 60 
the {H^ocessing for restoring the configuration in which 
odd-field line signals and even-field line signals are sepa- 
rated from each other to the configuration in which odd and 
even-field line signals alternate with each other, is per- 
formed by the motion compensation circuit 87. 65 

The processing of the luminance signals has been 
explained in the foregoing. As will be appreciated by one of 
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ordinary skill in the ait, the processing of the color differ- 
ence signals is earned out in a similar manner. However, the 
motion vector eiiq>loyed in sudi case is the motion vector for 
luminance signals which is halved in both the vertical and 
■[ 5 horizontal directions. 

I FIG. 10 shows the signal to noise ratio (SNR) for pictures 

• transmitted using the above-described technique. As can be 
seen, the best quality transmission is obtained for I-pictures, 
good quality transmission is obtained fOT P-pictures, and the 

' *o poorest quality transmission is obtained for B-pictures. 

! Thus, if the transmission path has adequate capacity, it is 
preferable to transmit a picture as an I-picturc. 

: If all pictures cannot be transmitted as I-picturcs. it is 

I better to transmit a series of pictures as shown in FIG. 10. 

: rather than in a format in which one average picture quality 
is used for all pictures. The technique shown in FIG. 10 
takes advantage of the human visual sense characteristic of 

' perceiving a series of dianging picture quality, as shown in 
FIG. 10. as of higher quality than a saies of unchanging 
^ picture quality. fOT a predetermined transmission rate. 

Accordingly, in the configuration of FIG. 6, transmission 
rate control is carried out by the quantizer 57 in order to 
attain the picture quality perceived as better. 
25 To dub pictures, two coder-decoder (codec) units are used 
in series. However, the picture quality obtained from the 
second codec is substantially worse than the picture quality 
obtained from the first codec, as explained below. 

FIG. 11 shows a configuration rqjresenting two codecs 
30 connected by an analog connection, namely, coder 201. 
decoder 202, coder 203 and decoder 204. connected in 
series. 

In FIG. 11, an analog video signal is supplied to an input 
terminal 200 as an input signal a. The input terminal 200 

35 functions to apply the analog video signal to an A/D con- 
verter 211 of coder 201. The converter 211 is adapted to 
convert the analog video signal to a digital video signal, and 
to apply the digital video signal to coding circuit 212 that 
serves to encode this signal as previously described to 

40 produce a coded digital video signal. 

The coded digital video signal from coding circuit 212 of 
coder 201 is suf^lied to a decoding circuit 213 of decoder 
202 which is adapted to decode the coded digital video 
signal and to apply the decoded video signal to D/A con- 
verter214. 

The analog video signal produced by D/A converter of 
decoder 202 is supplied as an output signal b to the coder 
203. which functions in a similar manner as the coder 201. 
. The digital video signal produced by the coder 203 is 
supplied to decoder 204 which functions in a similar manner 
as the decoder 202. The decoder 204 delivers an analog 
video signal as an output signal c to a tominal 205. which 
may transmit the signal c to another coder (not shown) and 
so on. 

FIG. 12 shows the SNR of the output signals b, c shown 
in FIG. 11. The SNR of the output signal c is seen to be 
substantially worse than the SNR of the output signal b. 
The deterioration in picture quality results from a mis- 
60 match between the picture type applied in the first codec and 
the picture type applied in the second codec. Namely, if a 
picture coded as a B picture in the first coder/decoder pair is 
coded as. e.g.. P picture in the second coder/decoder pair, a 
great deterioration of picture quality results because the 
65 picture quality changes as a function of the picture type. 
Since the deterioration in picture quality results from the 
mismatch brtween picture types of respective stages of 
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codecs, such deterioration similarly takes place when digital 
connections arc used between respective codecs. 
FIG. 13 shows a configuration representing two codecs 
* connected by a digital connection, namely, coder 302. 

decoder 303. coder 304 and decoder 305. connected in 
series. 

An analog video signal is supplied to terminal 300. which 
supplies the analog video signal as an input signal a to A/D 
converter 30 1 that serves to digitize the signal a. and to apply 
the digital signal to a digital interface 311 of coder 302. The 
digital interface 311 ^lies the signal supplied thereto to a 
coding circuit 312 which encodes or compresses the digital 
video data to an encoded digital video bit stream. 

The encoded digital video signal from the coding circuit 
312 is supplied to decoding circuit 313 of decoder 303 that 
decodes the signal supplied thereto, and applies the decoded 
signal to digital interface 314. The interface 314 functions to 
output the decoded signal as an output signal b. 

The output signal b is supplied to coder 304 which 20 
functions in a similar manner as coder 302 to produce a 
coded signal that is applied to decoder 305 which functions 
in a similar manner as decoder 303. The digital signal output 
from the decoder 303 is supplied to a D/A converter tfiat 
serves to convert the signal supplied thereto to an analog 25 
- video signal and to sui^ly the analog video signal as an 

^ output signal c to output terminal 307. 

= FIG. 12 also generally represents the SNR of the output 

4= signals b, c shown in FIG. 13. 

.h 30 

OBJECTS AND SUMMARY OF THE 
INVENTION 

Therefore, an object of the present invention is to provide 
a method and apparatus for encoding and decoding picture 
signals which avoid the aforementioned disadvantages of the 35 
prior art. 

Another object of the present invention is to provide a 
method and apparatus for transmitting and receiving picture 
signals in serial stages which minimizes the deterioration in ^ 
picture quality at each stage. 

Yet an(rther object of the present invention is to match the 
type of coding applied to pictures of a picture signal in serial 
processing stages, each stage comprising coding and decod- 
ing- 45 

In accordance with one embodiment of the present 
invention, apparatus and method for processing a digital 
picture signal operate by receiving a digital picture signal 
whidi has picture type d^ induded in a data identification 
area of the digital picture signal and which indicates one of 5Q 
intrapicturc coding, predictive coding and bidirectionally 
p-edictive coding for respective pictures represented by the 
digital picture signal. The picture signal is encoded as a 
function of the picture type data to produce an encoded 
picture signal. 55 

In accordance with another embodiment of the present 
invention, a^iaratus and method for processing an encoded 
digital picture signal opcraXe by decoding the encoded 
digital picture signal so as to produce picture type data 
whidi represents the type of encoding of the encoded digital eo 
picture signal and to produce a decoded digital picture 
signal. The picture type data is added to a data identification 
area of the decoded digital picture signal to produce an 
CMitput signal. 

The above, and other objects, features and advantages of 65 
the present invention will be apparent from the following 
detailed description of the preferred embodiments of the 
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present iovendoo v/hca read in conjuoc^on with the accom- 
panyuig drawings in ^^cfa conesponding parts are identi- 
fied by die same reference numeral. 

J BRIEF DESCRIPTION OF THE DRAWINGS 

FIGS, lA and IB arc pictures illustrating inter-firame 
correlation; 

FIGS. 2A and 2B are diagrams illustrating types of 
pictures used in predictive encoding; 

FIG. 3 is a diagram illustrating how picture signals are 
converted into encoded data for transmission; 

FIG. 4 is a block diagram showing a conventional device 
for encoding and decoding picture signals; 

FIG. 5 is a diagram referred to in explaining the operation 
of the format converting circuit shown in FIG. 4; 

FIG. 6 is a block diagram showing the encoder of the 
device shown in FIG. 4; 

FIG. 7 is a chart referred to in explaining the predictive 
20 encoding operation of the encoder shown in FIG. 6; 

FIG. 8 is a chart referred to in explaining the orthogonal 
transfannation operation of the encoder shown in FIG. 6; 

FIG. 9 is a block diagram showing the decoder of the 
device shown in FIG. 4; 
25 FIG. 10 is a graph showing picture quality as a function 
of picture type in a transmitted signal; 

FIG. 11 is a block diagram showing two conventional 
video codecs connected in series using an analog connec- 
tion; 

^ FIG. 12 is a graph showing picture quality of the signals 
ou^ut by the codecs of FIG. 11; 

FIG. 13 is a block diagram showing two conventional 
video codecs connected in series using a digital connection; 
35 FIG. 14 is a block diagram showing two video codecs 
according to the present invention connected in series using 
an analog connection; 

FIG. 15 is a graph showing picture quality of the signals 
output by the codecs of FIG. 14; 
40 FIG. 16 is a block diagram showing two video codecs 
according to the present invention connected in series using 
a digital connection; 

FIGS. 17A. 17B and 17C illustrate the data structure of a 
decoded digital video signal; 
45 FIGS. 18A, 18B and 18C are diagrams illustrating various 
encoding stmcturcs of graips of pictures; 

FIG. 19 is a block diagram showing a coder circuit 
according to the present invention; and 

FIG. 20 is a block diagram showing a decoding circuit 
^ according to the present invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

The present invention comprises a picture type identifier 
55 which is included with the picture signal at all times, namely, 
when tfie signal is encoded and when the signal is decoded. 
The picture type indicates one of intra-picture coding (an 
I-picture), predictive coding (a P-picture) and 
bi-directionally predictive coding (a B-picture). An I-picture 
60 includes macro-blocks encoded by only intra-coding. A 
P-piaure includes macro-blocks encoded by intra-coding 
and/or macroblocks encoded by forward predictive coding. 
A B-picturc includes macro-blocks encoded by intra-coding 
and/or macroblocks encoded by forward predictive coding 
65 and/or macroblocks encoded by backward predictive coding 
and/or macroblocks encoded by bi-directionally predictive 
coding. 
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Initially, each picture of a picture sigaal is encoded as a 
funcdoo of a respective picture type, then app-opriateiy 
decoded. The decoded picture signal includes the respective 
picture types, preferably in the vertical blanking interval of 
each decoded picture. The decoded picture signal may be 5 
further processed by, for example, dubbing. 

When the pictures of the decoded picture signal are again 
encoded, the re-encoding is a function of the picture type 
included in the decoded picture signal. The re-encoded 
signal includes the picture type. Subsequent decoding of the lO 
re-encoded picture is a function of the picture type. Each 
picture of the re-decoded picture signal includes its respec- 
tive picture type. 

Thus, the present invention matches the type of predictive 
coding applied to pictures in a picture signal by serially 
arranged coders which process the picture signal. 

The present invention promotes optimum picture quality. 
A picture, previously encoded as an I-picturc. P-picturc or 
B-picture is again encoded as an l-picture. P-picture or 
B-picture, respectively. Also, encoding of a picture, previ- ^ 
ously encoded as a B-picture. as an I-picture or a P-picture 
is prevented. Thus, deterioration in signal quality after plural 
' " coding and decoding operations is minimized. 

Referring now to the drawings, and in partiailar to FIG. ^ 
Q 14. there are illustrated coding and decoding units (codecs) 

."^ according to the present invention having a serial analog 

''p connection therebetween. A first codec comprises coder 120 

and decoder 121. while a second codec conqirises coder 122 
*0 and decoder 123. It will be appreciated by one of ordinary ^ 

\l skill in the art that additional codecs may be serially con- 

nected to those shown in FIG. 14. 

In FIG. 14. an analog video signal is supplied to an input 
terminal 100 as an input signal a. and a picture type signal 
is supplied to an input tenninal 108. The picture type 3^ 
indicates one of intra-picture coding (an I-picture), predic- 
tive coding (a P-picture) and bi-directionally predictive 
coding (a B-pictiu-e). 
The input terminals 100. 108 function to ^ply the analog 
O video signal and the picture type signal, respectively, to an ^ 

pj A/D converter 101 and a coding circuit 102, respectively, of 

g coder 120. The converter 101 is adapted to convert the 

^ , analog video signal to a digital video signal, and to apply the 

Q digital video signal to the coding circuit 102. 

The coding circuit 102 serves to encode the digital video 45 
signal as a function of the picture type signal to produce a 
coded digital video signal which indudes, for each encoded 
picture, its picture type as identified by the picture type 
signal. More specifically, if the picture type for a picture 
indicates intra-picture coding, then the coding circuit 102 50 
codes the picture as an I-picture. If the picture type for a 
picture indicates predictive coding, then the coding circuit 
102 codes the picture as a P-picture. If the picture type for 
a picture indicates bi-directionally predictive coding, then 
the coding circuit 102 codes the picture as a B-picture. 55 

The coding unit 120 may alternatively have the structure 
shown in FIG. 6. in which coding is performed without 
reference to an eternally supplied picture type. As used 
herein, an externally supplied picture type means a picture 
type suRJlied firom generally the same source as supplies the 60 
digital video signal, rather ttian from a separate source as is 
shown in FIG. 6, namely, the picture type input device 65. 

The coded digital video signal from coding circuit 102 of 
FIG- 14 is supplied to a decoding circuit 103 of decoder 121 
which is adapted to decode the coded digital video signal as 65 . 
a function of the picture type included in the encoded signal 
and to apply the decoded video signal to D/A converter 104. 
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The decoding circuit 103 is further adapted to apply the 
picture type decoded from the coded digital video signal to 
a nudtiplexcr 105. 
The multiplexer 105 is operative to multiplex the picture 
5 type infomation with the decoded video signal to jKoduce 
a multqjlexed analog video signal as an ou^ut signal b in 
whidi the picture type information is contained in the 
decoded video signal. Preferably, the multiplexer 105 inserts 
the picture type for a picture of the decoded video signal into 
*o the vertical blanking interval of the picture. As mentioned, 
a picture may be cither a frame or a field of the video signal. 

The output signal b is supplied from the multiplexer 105 
to a separating circuit 106 of the coder 122. The separating 
circuit is operative to separate or demultiplex the analog 
video signal and the picture type information from the 
output signal b. to supply the separated analog video signal 
to an A/D converter 107, and to supply the separated picture 
type information to a coding circuit 108. The converter 107 
is adapted to convm the separated analog video signal to a 
digital video signal, and to apply the digital video signal to 
the coding circuit 108. 

The coding circuit 108 serves to encode the digital video 
signal as a function of the sqjarated picture type to produce 
25 a re-coded digital video signal which includes, for each 
re-encoded picture, its picture type as identified by the 
separated picture type signal. 

The re-coded digital video signal from the coding circuit 
108 is supplied to the decoder 123. which operates in a 
30 similar manner as the decoder 121. 

Decoding circuit 110 of decoder 123 decodes the re-coded 
digital video signal to produce a re-decoded digital video 
signal and a corresponding picture type signal. The 
re-decoded digital video signal is converted to an analog 
35 signal by D/A converter 109. and applied to a multiplexer 
111 which multiplexes the analog video signal with the 
picture type signal from decoding circuit 110 to produce a 
multiplexed analog video signal as an ou^ut signal c. 
Preferably, the multiplexer 111 inserts the picture type for a 
40 picture into the vertical blanking interval of the picture. The 
multiplexer 111 applies its output signal c to an output 
tominal 119. 

Due to the inclusion of the picture type identifier in the 
signals b and c. the codecs of FIG. 14 process respective 
45 pictures of the video signals b and c in the same manner, that 
is, as the same one of an I-picture, a P-picture ot a B-picture. 

FIG. 15 shows the SNR of the output signals b, c shown 
in FIG. 14. The SNR of the outjMit signal c is seen to be only 
^ slightly worse than the SNR of the output signal b. 

That is, since the type of predictive coding applied to each 
picture is the same in each of the serially arranged codecs, 
the deterioration in picture quality at each codec is mini- 
mized even when the picture quality changes from picture to 
picture due to the type of predictive coding employed from 
picture to picture. 

FIG. 16 shows codecs according to the present invention 
having a serial digital connection therebetween. A first codec 
comprises coder 142 and decoder 143. while a second codec 

60 comprises coder 144 and decoder 145. 

In FIG. 16, an analog video signal is supplied to an input 
terminal 140 as an input signal a. and a picture type signal 
is supplied to an input terminal 148. The input terminals 140, 
148 function to apply the analog video signal and the picture 

65 type signal, respectively, to an A/D converter 141 and a 
coding circuit 152 of coder 142, respectively. The converter 
141 is adapted to convert the analog video signal to a digital 
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video signal, and to aj^ly the digital video signal to a digital 
interface 151 of coder 142. 

The coding circuit 152 serves to encode the digital video 
signal as a function of the picture type signal to produce a 
coded digital video signal which indudcs. for each encoded 5 
picture, its picture type as identified by the picture type 
signaL More specifically, if the picture type for a picture 
indicates intra-picturc coding, then the coding circuit 152 
codes the picture as an I-picture. If the picture type for a 
picture indicates predictive coding, then the coding circuit 
152 codes the picture as a P-picture. If the picture type for 
a picture indicates bi-directionally predictive coding, then 
the coding circuit 152 codes the picture as a B-picture. 

The coding unit 120 may alternatively have the structure 
shown in FIG. 6, in which coding is performed without 
reference to an externally supplied picture type. 

The coded digital video signal fi-om coding circuit 152 is 
supplied to a decoding circuit 153 of decoder 143 which is 
adapted to decode the coded digital video signal as a 
function of the picture type included in the encoded signal 
and to apply the decoded video signal to a digital interface 
154. The decoding circuit 153 is further adapted to apply the 
picture type decoded from the coded digital video signal to 
a multiplexer 155. 25 

The multiplexer 155 is operative to multiplex the picture 
type information with the decoded video signal to produce 
a multiplexed digital video signal as an output signal b in 
whidi the picture type information is contained in the 
decoded video signal. Preferably, multiplexer 155 multi- ^ 
plcxes the picture type for a picture of the decoded video 
signal as a flag in the respective picture. 

In a preferred embodiment of the present invention, the 
picture type information is inserted (or multiplexed) into the 
decoded video signal at a location therein which precedes 35 
the actual video data that represents the video field or frame, 
FIGS. 17A, 17B and 17C illustrate the data strucuu^e of the 
decoded (MPEG) video signal. FIG. 17A illustrates the data 
structure of a decoded video signal having a serial digital 
interface format as specified in the standard SMPTE — 259 40 
(Society of Motion Picture & Television Engineers). As 
shown, a frame consists of a first vertical blanking area 
VBKl, a first optional blanking area OBKl and a first active 
video area ACVl. which constitutes the first field, followed 
by a second vertical blanking area VBKl. a second optional 45 
blanking area 0BK2 and a second active video area ACV2. 
which constitutes the second field. In the preferred 
embodiment, each of the vertical blanking areas consists of 
9 horizontal scanning lines, each of the optional blanking 
areas consists of 10 horizontal scanning lines, the first active 50 
video area consists of 244 horizontal scanning lines and the 
second active video area consists of 243 horizontal scanning 
lines, for a total of 525 horizontal scanning lines for a single 
frame. 

FIG. 17B illustrates the data structure of a hOTizontal 55 
scanning line. As shown, a horizontal scanning line includes 
an end of active video (EAV) area followed by an ancillary 
(ANC) area, a start of active video (SAV) area and a video 
area. The ANC area, as shown in FIG. 17C. includes an 
ancillary data flag (ADF) area followed by a data identifi- 60 
cation (DID) area, an andllary number data (DBN) area, an 
ancillary word data (DC) area, an ancillary data (ANC 
DATA) area, and a chedt sum (CS) area. Since the above- 
noted areas of a horizontal scanning line of digital data are 
well-known in the art their descriptions are omitted herein 65 
except where necessary for an understanding of the present 
invention. 
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In accordance with the present invention, the picture type 
infonnation is inserted into the DID area of the ANC area of 
each of the horizontal scanning lines in the first and second 
vertical blanking areas. However, the picture type informa- 

5 tion also may be inserted into the DID area of the ANC area 
of other horizontal scanning lines of the decoded video 
signal, although these DID areas may be used for transmit- 
ting other types of data. Fot example, the DID areas in 
horizontal lines of non-vertical blanking areas may include 
other formatting infcffmation. 

The picture type information (or picture type data) may 
identiiy the type of encoding of the picture (e.g.. intra- 
picture coding, predictive coding, and bi-directionally pre- 
dictive coding) in various ways. FIGS. 18A to 18C illustrate 
one method in which the type of encoding is identified by the 
structure of the group of pictures (GOP). As shown, the 
structure of a group of pictures (GOP) may be identified by 
the minimum number of frames "M" between I and P 
pictures, between P and P pictures, and between I and I 
pictures, and the total number of frames *l<r' (pictures) in the 

^ group of pictures. For exan^jle. FIG. 18A illustrates groups 
of pictures having an encoding structure of M=3 and N=9 in 
which there are 9 frames in each group and wherein there are 
3 frames firom each I or P frame to the respectively suc- 
ceeding I or P frame. Similarly, FIG, 18B illustrates groups 
of pictures having an encoding structure of M=2 and N=2. 
and FIG. 18C illustrates groups of pictures having an 
encoding structure of M=l and N=2. 

When the picture type data identifies the "M" and "N" 
numbers, the type of encoding for ea(Ai picture can be 

^ determined by the location of a respective picture within the 
group of pictures, and the location of a respective picture 
may be identified in the picture type data either by identi- 
fying eadi picmrc*s location within the group of pictures or 
by identifying only the first picture within the group of 
pictures. For example, when M=3 and N=9 for a group of 
frames in the decoded video signal (FIG. ISA), the third 
frame in that group is identified as a decoded I-frame. 

Returning to FIG. 16, the output signal b (the multiplexed 
decoded video signal) is supplied from the multiplexer 155 
to a separating circuit 156 of the coder 144, The separating 
circuit is operative to sqjaratc or demultiplex the digital 
video signal and the picture type data from the output signal 
b. to supply the sqjarated digital video signal to a digital 
interface 157. and to supply the separated picture type data 
to a coding circuit 158. The interface 157 is adapted to apply 
the separated digital video signal to the coding circuit 158. 

The coding circuit 158 serves to encode the sqjarated 
digital video signal as a function of the separated picture 

5Q type to produce a re-coded digital video signal which 
includes, for each re-encoded picture, its picture type as 
identified by the separated picture type signal. 

The rc-coded digital video signal from the coding circuit 
158 is supplied to the decoder 145. which operates in a 

55 similar manner as the decoder 143. 

Decoding circuit 160 of decoder 145 decodes the re-codcd 

' digital video signal to produce a re-decoded digital video 
signal and a corresponding picture type signal. The 
re-decoded digital video signal is suf^lied to a digital 

60 interface 159 and thence to a multiplexer 161 which multi- 
plexes the re-decoded digital video signal with the picture 
type signal from decoding drcuil 160 to produce a multi- 
plexed digital video signal. The multiplexer 161 multiplexes 
the picture type signal as a flag (e,g., in the DID area of the 

S5 ANC area) in the re-decoded digital video signal. 

The multiplexer 161 suRilies the mult^lexed digital 
video signal to an A/D converter 146 which serves to convert 




the miilt^lexed digital video signal to ao analog video signal 
also rcforcd to as output signal c. The converter 146 ^lies 
the output signal c to an ou^Mit terminal 147. 

Due to the inclusion of the picture type identifier in the 
signals b and c, the codecs of FIG. 16 process respective 5 
pictures of the video signals b and c in the same manner, that 
is. as the same one of an I-picturc, a P-picturc or a B-picturc. 
Consequently, the deterioration in picture quality at each 
codec is minimi?^ even when the picture quality changes 
from picture to picture due to the tjpe of predictive coding 
employed from picture to picture. 

FIG. 19 shows the coding circuits of FIGS. 14 and 16 in 
more detail In RG. 19. elements similar to those in FIG- 6 
are indicated by the same reference numerals, and detailed 
explanations thereof are omitted. 

In FIG. 19. a picture type signal is supplied to input 
terminal 70 whidi serves to supply the picture type signal to 
mcdon vector detector 450. predictive Judging circuit 454 
and variable length coding circuit 458. The processing 
performed by elements 450. 454 and 458 is similar to the 
processing performed by elements 50. 54 and 58 of FIG. 6. ^0 
except that the elements of FIG. 19 perform in accordance 
with the picture type identified in the external picture type 
sigaal which indicates the picture type used in previous 
coding. The variable length coding circuit 458 includes the 
picture type based on the external picture type signal as part 25 
of the header information. 

FIG. 20 shows the decoding circuits of FIGS. 14 and 16 
in more detail. In FIG. 20. elements similar to those in FIG. 
9 are indicated by the same reference numerals, and detailed 
explanations thereof are omitted. 30 

Variable length decoding circuit 482 of FIG. 20 is similar 
to variable length decoding circuit 82 of FIG. 9. except that 
circuit 482 aj^lies the picture type separated from the 
encoded signal not only to motion compensator 487. but also 
to ou^ut tcxminal 92. 35 

Although an illustrative embodiment of the present 
invention, and various modifications thereof, have been 
described in detail herein with reference to the accompany- 
ing drawings, it is to be understood that the invention is not 
limited to this precise embodiment and the described 40 
modifications, and that various changes and further modi- 
fications may be effected therein by one skilled in the art 
without departing from the scope or spirit of the invention as 
defined in the appended claims. 

What is claimed is: 45 

1. An apparatus for processing a digital picture signal, 
comprising: 

means for receiving a digital picture signal having picture 
type data included in a data identification area of said 
digital picture signal indicating one of intrapicture 50 
coding, predictive coding and bidirectionally predictive 
coding for respective pictures represented by said digi- 
tal picture signal, said picture type data identifying an 
encoding structure of a group of pictures represented by 
said digital picture signal and farther identiiying each 55 
respective picture within said group of pictiffes so as to 
identify the type of encoding of said digital picture 
signal for eadi said picture; and 

coding means for encoding said digital picture signal as a 
function of said picture type data to produce an 60 
encoded digital picture signal. 

2. The apparatus of claim 1. wherein said picture type data 
identifies previous types of coding for said respective pic- 
tures represented by said digital picture signal. 

3. The apparatus of claim 1, wherein said means for 65 
receiving includes means for extracting said picture type 
data from said digital picture signal. 



